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Abstract 



Several convergence results in Hilbert scales under different source conditions are 
proved and orders of convergence and optimal orders of convergence are derived. Also, 
relations between those source conditions are proved. The concept of a multiple Hilbert 
scale on a product space is introduced, regularization methods on these scales are de- 
' ■^ | fined, both for the case of a single observation and for the case of multiple observations. 

In the latter case, it is shown how vector-valued regularization functions in these mul- 
tiple Hilbert scales can be used. In all cases convergence is proved and orders and 
optimal orders of convergence are shown. 
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1 Introduction 



Quite often an inverse problem can be formulated as the need for determining x in an 
equation of the form 

Tx = y, (1) 

h ; 

where T is a linear bounded operator between two infinite dimensional Hilbert spaces X 
and y, the range of T, 1Z(T), is non-closed and y is the data, which is known, perhaps 
with a certain degree of error. It is well known that under these hypotheses, problem (JT]) 
is ill-posed in the sense of Hadamard (|6j). The ill-posedness is reflected in the fact that 
T', the Moore- Penrose generalized inverse of T, is unbounded and therefore small errors or 
noise in the data y can result in arbitrarily large errors in the corresponding approximated 
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solutions (see [14], [13]), turning unstable all standard numerical approximation methods, 
making them unsuitable for most applications and inappropriate from any practical point 
of view. The so called "regularization methods" are mathematical tools designed to restore 
stability to the inversion process and consist essentially of parametric families of continuous 
linear operators approximating T>. The mathematical theory of regularization methods is 
very wide (a comprehensive treatise on the subject can be found in the book by Engl, Hanke 
and Neubauer, [I]) and it is of great interest in a broad variety of applications in many areas 
such as Medicine, Physics, Geology, Geophysics, Biology, image restoration and processing, 
etc. 

There exist numerous ways of regularizing an ill-posed inverse problem. Among the 
most standar and traditional methods we mention the Tikhonov-Phillips method (p2], |15j . 
|16j). truncated singular value decomposition (TSVD), Showalter's method, total variation 
regularization Qlj), etc. Among all regularization methods, probably the best known and 
most commonly and widely used is the Tikhonov-Phillips method, which was originally 
proposed by Tikhonov and Phillips in 1962 and 1963 (see [12] , |15j . [T6]). Although this 
method can be formalized within a very general framework by means of spectral theory ([1], 
[2] ) , the widespread of its use is undoubtedly due to the fact that it can also be formulated in 
a very simple way as an optimization problem. In fact, the regularized solution of problem 
([1]) obtained by applying Tikhonov-Phillips method is also the minimizer x a of the functional 



where a is a positive constant known as the regularization parameter. The penalizing term 
a ||x|| 2 in (T5]) not only induces stability but it also determines certain regularity properties of 
the approximating regularized solutions x a and of the corresponding least-squares solution 
which they approximate as a — > + . Thus, for instance, it is well known that minimizers 
of (T5]) are always "smooth" and, for a — > + , they approximate the least-squares solution of 
minimum norm of ([1]), that is lim a _ s . + x a — T^y. This method is more precisely known as 
the Tikhonov-Phillips method of order zero. Other penalizers in ([2]) can also be used. For 
instance, in his original articles ([32], [IS]), Tikhonov considered the more general functional 



where L is an operator defined on a certain domain T>(L) C X, into a Hilbert space Z. Usu- 
ally L is a differential operator and hence it has a nontrivial nullspace. In spline smoothing 
problems for instance (see [H]), L is taken as the second derivative operator. 

The use of fl3]) to regularize problem (TjQ) automatically implies the a-priori knowledge or 
assumption that the exact solution belongs to T>(L). This approach gives rise to the theory 
of generalized inverses and regularization with seminorms (see for instance [I], Chapter 8). 
The use of Hilbert scales becomes appropriate when there is no certainty that the exact 
solution is in fact an element of T>(L). 

The structure of this article is as follows. In Section 2 we briefly recall the theory of 
regularization methods in Hilbert scales. In Section 3 we prove several convergence results 
in Hilbert scales under different source conditions and establish orders of convergence and 
optimal orders of convergence. Also, relations between those source conditions are proved. 
In Section 4 the concept of a multiple Hilbert scale on a product space is introduced, regu- 
larization methods on these scales are defined, first for the case of a single observation and 
then for the case of multiple observations. In the latter case, it is shown how vector- valued 
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J a (x),L = \\Tx - y\\ 2 + a \\Lx\\ 2 , 
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regularization functions in these multiple Hilbert scales can be used. In all cases convergence 
is proved and orders and optimal orders of convergence are shown. 

2 Regularization in Hilbert Scales 

In this section we will introduce the definition of a Hilbert scale and a few known results 
that will be needed later. All of them can be found in classical books and articles on the 
subject such as jl] and [TO] . 

Throughout this work we will assume that L is a densely defined, unbounded, strictly 
positive self-adjoint operator on a Hilbert space X, so that L is closed and satisfies (Lx, y) = 
(x, Ly) for every x, y G T>(L) and there exists a positive constant 7 such that 

(Lx, x) > 7 ||x|| 2 for every x G T>(L). (4) 

Consider the set M. of all elements x G X for which all natural powers of L are defined, 

00 

that isM = f]V(L k ). By using spectral theory it can be easily shown that the fractional 

k=l 

powers L s are well defined over A4 for every s G R and that 

M = p| V{U) (5) 

(for a detailed and comprehensive treatment of fractional powers of strictly positive self- 
adjoint operators see for instance [UJ and [2]). 

Definition 2.1. (Hilbert scales) Let KA be defined as in (TJJ). For every t G R we define 

(x,y) t = (L*x,L*y), forx,y,eM. (6) 

It can be immediately seen that (■, -) t defines an inner product in A4, which in turn induces 
a norm \\x\\ t = \\L t x\\. The Hilbert space X t is defined as the completion of M. with respect 
to this norm \\-\\ t . The family of spaces (X t )tm is called the Hilbert scale induced by L over 
X. The operator L is called a "generator" of the Hilbert scale (X t ) te ^. 

Remark 2.2. Note that a Hilbert scale is a completely ordered (by set inclusion) parametric 
family of Hilbert spaces and if the operator L is bounded then X t = X for every t G R. 

The following proposition constitutes one of the fundamental results for the treatment of 
inverse ill-posed problems in Hilbert scales. 

Proposition 2.3. Let (X t ) te -^ be the Hilbert scale induced by L over X . Then the following 
is true: 

i) For every s,t G R such that —00 < s < t < 00, the space X t is continuously and densely 
embedded in X s . 

ii) Let s,t £ R. The operator L l ~ s defined on Ad has a unique extension to X t which is 
an isomorphism (surjective isometry) from X t onto X s . This extension, also denoted 
with L l ~ s , is self-adjoint and strictly positive seen as an operator in X s with domain X t , 
if t > s. Also, the identity L l ~ s = L f L~ s is valid for the appropriate extensions. In 
particular (i^) -1 = L~ s . 
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Hi) If s > 0, then X s = T>(L S ) and X_ s = (X s )' ; that is X_ s is the topological dual of X s 
(with the topology induced by the norm in X). 

iv) Let q,r,s G R be such that —oo <q<r<s<ocyx£ X s . Then the following 
interpolation inequality holds: 

\\x\\ r < \\x\\r* \\x\\T q . (7) 

Proof. See [3], Proposition 8.19. ■ 

In the remaining of this section we will state several results which will be of fundamen- 
tal importance in the following sections. In all cases we have been included appropriate 
references where their proofs can be found. 

Theorem 2.4. (Heinz Inequality) Let A and L be two linear, unbounded densely defined, 
strictly positive, self-adjoint operators on a Hilbert Space X such that 

V(A) C V(L) (8) 

and 

\\Lx\\ < \\Ax\\ VxeV(A). (9) 
Then for every v G [0, 1] there holds 

V{A V ) c V[U) (10) 

and 

\L v x\ < \A*x\ VxeV(A v ). (11) 
Proof. See [I], Proposition 8.21, page 213 (see also [7] and [8]). ■ 



Remark 2.5. It is important to point out here that the result of Theorem\2.4\ remains valid 



under slightly weaker hypotheses on the involved operators. More precisely, it can be shown 
that the result remains valid if the operators A and L satisfy conditions |2j) and (TJ|) and are 
self-adjoint and nonnegative instead of strictly positive. 

Lemma 2.6. Let T : X — > y be a linear bounded operator between the Hilbert spaces X 
and y and L a linear, densely defined, self-adjoint, unbounded and strictly positive operator 
on the space X . Let (Xt)teR be the Hilbert scale induced by L over X . If there exist constants 
< m < M < oo and a G M + such that 

m \\x\\_ a < \\Tx\\ < M \\x\\_ a \/xeX, (12) 

then K{T*) = X a (that is, TZ(T*) = V(L a ) = IZ(L- a )). 

Proof. See [3]. ■ 



Remark 2.7. Note that if [W) holds, then the operator T is injective. Also note that (TTi 
essentially says that the operator T induces a norm on X which is equivalent to that inherited 
by X from the Hilbert scale of order t = —a, generated by the operator L over X . Hence, it is 
reasonable to think, in intuitive terms, that the degree of regularity induced by T is equivalent 
to the degree of regularity induced by L~ a , and therefore the same happens with the degree of 
ill-posedness of their respective inverses. 
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Theorem 2.8. Let T : X — > y be a linear bounded operator between the Hilbert spaces X 
and y and L a linear, densely defined, self-adjoint, unbounded and strictly positive operator 
on X . Let (X t )tm be the Hilbert scale induced by the operator L over X . Suppose that 
the operator T satisfies KW\) for some a > and < m < M < oo. Given s > define 
B = TL~ S where L~ s is considered extended to all X in the sense of Proposition \2.3\ ii). 
Then for every v G [0, 1] we have that 

m v \\x\\_ v{a+s) < \\{B*B)ix\\ < ||x|U (a+s) , V*G X, (13) 

M- V \\x\\ v{a+S) <\\{B*B)-*x\\ <m- v \\x\l {a+s) , V x e V((B* B)^). (14) 

Also 

K((B*B)%) =X u{a+s) . (15) 

Proof. See [3] (see also 0] Corollary 8.22, page 214). ■ 

Remark 2.9. // the operators L~ l y T*T commute, then (T5\) remains valid also for v > 1. 
This result, which we will prove later on (Theorem \3.1Ch) . will be of fundamental importance 
in the extension of some results on convergence of some regularization methods in Hilbert 
scales, which will be presented in Section 3. 

The inequalities in ( 1T31) can be interpreted in a similar way as it was done for ( TT2l) in 
the Remark 12.71 In fact, taking as "unit of regularity" the degree induced by the operator 
L -1 , the respective degrees of regularity induced by L~ s and T are s and a, respectively. 
Hence the degree induced by B = TL~ S is a + s, the degree induced by B*B is 2(a + s) and, 
therefore, the degree of regularity induced by (B*B)% is |2(a + s) — v(a + s). 

The idea of using Hilbert scales for regularizing inverse ill-posed problems was first in- 
troduced by Natterer in 1984 ([10]) for the special case of the classical Tikhonov-Phillips 
method. In his work Natterer regularized the problem Tx = y by minimizing the functional 

\\Tx — y s \\ 2 + a \\x\\ s , (16) 

over the space X a , where ||-|| s denotes the corresponding norm in the Hilbert scale (see 
Definition El]). 

In certain cases it is possible that a value of s > be known for which we are absolutely 
sure that the exact solution x\ G X So , where (X t ) t£R is the Hilbert scale induced by the 
operator L over X. In such cases it is possible to proceed with regularization of the problem 
Tx = y by means of the traditional methods, by replacing the Hilbert space X by X SQ and, 
obviously T by its restriction to V(L S °). In other cases, however, it is possible that such a 
value of s be not exactly known, although it could be reasonable to assume the existence of 
some u > for which 

x f G X u , (17) 

(although the exact value of u be unknown). It is precisely in this case in which Hilbert scales 
provide a solid mathematical framework for the development of convergent regularization 
methods which allow us to take advantage, in a optimal and "adaptive" way, of the source 
condition (FT?]) in order to obtain the best possible convergence speed, even though u is 
unknown. 

The first result about convergence on Hilbert scales is due to F. Natterer ([10]) and is 
presented in the next theorem. 
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Theorem 2.10. Let T G C(X,y) with X and y Hilbert spaces, the Moore-Penrose 
generalized inverse of T, L : T>(L) C X — > X a linear, densely defined, self-adjoint, 
unbounded operator with L > 7 for some 7 > and (X t )t^R the Hilbert scale induced by L 
over X . Suppose also that condition |U| ) holds. Let s > and B = TL~ S , as in Theorem 
\KE Let g a : [0, \\B\\ 2 ] R, a > 0, be a family of piecewise continuous functions and 
r a {X) = 1 — Xg a (X). Suppose also that {g a } satisfies the following conditions: 

CI : V A G (0, ||S|| 2 ] we have that lim g a (\) = -; (18) 

o^o+ A 

C2 : 3 c > such that V A G (0, ||B|| 2 ] and V a > there holds \g a {\)\ < ca~ l ; (19) 

C3 : 3 /i > 1 snc/i that if fi G [0,^ ] then A M |r«(A)| < c M a M V A G (0, ||B|| 2 ], (20) 

where c M zs a positive constant. 

For y G P(T^), / G ^ \\y — y 5 \\ < 5 we define the regularized solution of the 
problem Tx = y s by 

x s a = R a y s = L- s g Q (B*B)B*y s . (21) 

Suppose that x* = T^y G X u for some «6 [0, a + 2s] and that the regularization parameter a 
is chosen as 

2(a + s) 
a-\-u 

(22) 

where c is a positive constant and a is the constant in [W\l . Then there exists a constant C 
( which depends on a and s but not on u) such that the following estimate for the total error 
holds: 

\\x s a -x f || < C \\x ] \\ a u +u 5^. (23) 

Proof. See jl], Theorem 8.23. ■ 

In Figure [T] the relation among the values of the parameters s and u of Theorem 12.101 is 
schematized. Observe that the largest possible value for s is The arrow indicates the 
space X s may or may not be contained in X u . The dashed curve represents the space X u 
indicating that the parameter u is unknown. 





Figure 1: The Hilbert scales in Theorem 12.101 



Remark 2.11. It is very important to point out the "adaptivity" of the order of convergence 
in Theorem \2.1(A In fact, note that although the regularized solutions x 6 a defined in /[21\) do 
not depend on the degree of regularity u of x^ , the order of convergence obtained does depend 
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on u. This order improves as u increases and it becomes asymptotically optimal in u. Also 
observe that in order to assure the order of convergence in (23\) it is necessary to choose s 
(note that R a depends on s) such that u < a + 2s. Since it is possible that u be unknown, it 
may happen that we may not be completely sure of the validity of such constraint. Note that 

in such a case, i.e. if u > a + 2s, an order of convergence O (^S~^j cannot be guaranteed 

for the total error. However, since X u C X v Vit > r\, in such circumstances we will still 

/ a + 2su \ / a + 2s \ 

obtain at least convergence of the order O ( S a+( - a+2s '> ) = O ( <5 2 ( a+s ) J . Thus, not choosing s 
sufficiently large will result in a worse order of convergence. 



3 Preliminary convergence results in Hilbert scales 

In the next theorem, which extends the results of Theorem I2.1UI we will show that conver- 
gence can be obtained when the parameter choice rule a is chosen in the form a = c5 e for 
all values of e in a certain interval, and not only for e = , corresponding to the choice 
in fl22|) . We will prove however that for this choice of e the order of convergence is optimal. 



Theorem 3.1. Let X, y, T, T\ L, {X t ) tm , s > 0, a > 0, B 
L- s g a {B*B)B*, y E V(T^), y s E y, \\y-y 5 \\ < S, u E [0, a + 2s), x 

y x s c 



TL , Qql ? T<X) Ra 

= T^y E X u , x a = R a y 

R a y s , all as in Theorem \2.1CK If the parameter choice rule a is chosen as a = c5 £ 



(c constant) and e 6 0, 



2(q+s) 



then: 



i) As S — >■ 0+ ; x s ->■ x t in X. 



ii) Moreover, \\x 5 a — xM 



0(5 a ) where a = min jl 



2(a+s) ' 2( 



U£ 1 

a+s) J 



> 0. 



Hi) The order of convergence for the total error is optimal when e is chosen as e 



in which case \\xi, 



x 



2(q+s) 
a+u ' 



Proof. First note that from conditions (fl9j) and (120]) it follows immediately that there exists 
a constant k > such that 



A /3 |c/ a (A)| < ka^\ Wf3 E [0, 1], Va > and VA E (0, 



(24) 



(we can take k = max{l + c , c} where c is the constant c M in (|2l7|) corresponding to \i = 0). 

We will now proceed to estimate the error due to noise in the data and the regularization 
error, separately. Without loss of generality we will suppose that y E 1Z(T) (otherwise we 

replace y by Qy where Q : y TZ(T); recall that y E V(T^) and T^y = T^ Qy). 
For the error due to noise we have: 



.2' . , 



\R a (y s -y)\\ 

\L- s g a (B*B)B*(y 5 -y)\ 
\g a (B*B)B*(y 5 ~y)\\^ 



s 

= fjfl (a + s) 



[B*B)^g a (B*B)B*(y 5 -y) 
[B*B)- 1/2 (B*B)^g a (B*B)B*(y s - y) 



by (LL3D with v = 



a + s 
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a + 2s 
' 2a + 2s 

\(BT l z 



= m -W^ (B*B)^^g a (B*B)(B*B)- 1/2 B*(y s - y) 
< m -T^U kaF&V \\(B*B)- 1/2 B*(y 5 - y)\\ ^by (£3) with /3 

<c 1( 5a^, (since || (fi*^)" 1 / 2 ^!! = 

where C\ = km < o+s ) . Therefore 

||x*-Xa|| < C^a^^. (25) 

At this point it is timely to note that the estimate for the error due to noise in ff25l) is 
independent of the degree of regularity u of the solution x^ . 

Next we proceed to estimate the regularization error \\x a — x^\\. Note in first place that 
from Proposition 12.31 ii) (with t = u and s = u — s), it follows that L u ~( u ~ s,> = U has a 
unique extension to X u which is an isomorphism from X u onto Af u _ s . It is important to point 
out here that it is precisely this property of the fractional powers of the operator L on the 
Hilbert scales induced by itself, what will allow us, in the end, to arrive to the adaptive 
convergence order that we want to prove. More precisely, note that whatever the value of 
u (perhaps unknown), L s always possesses a unique extension to X u . This extension, also 
denoted with L s , regarded as an operator on X u - S with domain X u , is self-adjoint and strictly 
positive if u > u — s. Then, since x^ G X u , it follows that 



L s x ] e x u _ s . 

On the other hand, if u > s, from Theorem 12.81 con v = 

X u _ s = 1l({B*B)^) 
From (1261) and (|27|) it follows that there exist v G X such that 

I u — s 

L s x ] = (B*B)^+^v. 
holds with v = {B*B)^^)L s xK 



yL T s - it follows that 

a+s 



(26) 



(27) 



(2f 



If u < s then 
Then, 



tl 



R a y - x ] \\ 

L- s g a (B*B)B*y-x^\\ 
L- s g a {B*B)B*BL s x^ -x^\\ 
L- s g a (B*B)B*BL s x ] - L- s L s x ] \ 
L- s [g a (B*B)B*B - I]L s x ] \\ 
L- s r a (B*B)L s x ] \\ 

L~ s r a (B*B)(B*B)^)v 
r a (B*B)(B*B)^^v 
(B*B)^^r a (B*B)v 



(since B*y = B*BL s x ] ) 



(by (E 
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< m 



< m 



m 



< m~ 



m 



a + s) 



i + s) 



(B*B)^+^(B*B)^+^r a (B*B)v 
(B*B)W)r a (B*B)v 



by (EES) with v 



a + s 



a+3 > c^a 2 < a+s ' || v | 



by flUD with ft 



S — U . 



a + s) 



tj S-—U II i i 



by (|T3j) with 1/ = 



2(a + s 
(by 
s — u 



a + s 



a a — It t* it j. | 



Hence, there exists C 2 = m < a + s ) M a + a such that 

II | | I I X I I U 

\\Xct — X < C*2 F Q;2(a+ S ) 



(29) 



Note that this estimate for the regularization error depends on the degree of regularity u of 
ar and it is relevant only for the case u > 0. 
Finally, from (J25J and ([29]) it follows that 

I I I I I I up ^ /y> I I I I I -y> /y>1" I I 

— q u || i | | 

< Ci(5a! 2 ( a + S ) +C 2 a 2(a+3) x T 

— - 1 - " I I I I u 

= C x 8 (c5 £ )^^ + C 2 (c5 £ )^+^ \\x j \\ u 

— a -I ea u , , , eu 

= ClC 2 ( a + s )(T 2(a + s) _|_ (J C 2(a + S ) M S^a + s) 
1 Z II lilt 

= 0(O> 



(30) 



where a = min < 1 



ae us 



This proves and %%). 



2(a+s) ' 2(a+s) 

To prove Hi), note that by virtue of (1301) it follows that the order of convergence is optimal 
when e is chosen such that 

1 - 



ae 



su 



2(a + s) 2(a + s) 



that is for e = — , in which case a = —7—. It is important to note here that this optimal 

a+u ' a+u 1 1 

order of convergence depends on a and u (that is on L, T and x^) but it does not depend on 
the choice of s. M 



In the next theorem we will prove that with the same parameter choice rule as in ( 1221) . 
it is possible to obtain a better order of convergence in a weaker norm or convergence in a 
stronger norm with a worse order. 

Theorem 3.2. Let X, y, T, T\ L, {X t ) tm , s > 0, a > 0, B = TL~ S , g a , r a , R a = 
L- s g a {B*B)B*, y E V(T^), y 5 E y, \\y - y 5 \\ < 8, u E [0, a + 2s], a* = j*y E X u , x a = R a y 
y x s a = R a y 5 , all as in Theorem \2.1CK Suppose that the parameter choice rule a is chosen as 
in $EB\), that is 

2(a + s) 
^ \ a+u 
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where c > 0. Then for every r 6 [—a, min{ii, s}] i/jere holds 



| x Q x I 



< C x 



t 1 1 a + u 



5 a+u . 



(32) 



where C is a constant depending on a, s and r but not on u nor on x^ 



Proof. First note that due to the restriction on r, we have that all in X r . Just 

like in the previous theorem, without loss of generality we will suppose that y G 1Z(T). 
For the error due to noise we have the following estimate: 



\Ra{y 6 -y 

\L- s g a (B*B)B*(y s -y 
\g a (B*B)B*(y s -y)\\ 



r — s 

< m a + s 



r — s 

m a + s 



r — s 

< m a + s 



(B*B)^g a (B*B)B*(y 5 -y) 

(B*B)^T(B*B)- 1/2 g a (B*B)B*(y 5 - y) 
(B*B) S ^Tg a (B*B)(B*B)- 1/2 B*(y s - y) 

< mS ka^) \\(B*B)- 1/2 B*(y 5 - y)\\ 

r—s —r — a ,, <- , , 

= m a + s ka 2 ^^ \\y — y \\ 



by (TT3D with v 



r 



a + s 



by <m with p 



a + 2s — r 
2(a + s) 



< m a + s ka 2( a + s ) S 
5 



< m a + a k 



x 1 



2(q+a) -| _ 2(a + s) 
a-\-u 



(by dMD) 



II Mm 

r—s _ a+r 

where Ci = m a + a fee 2 ( a + s ) . Thus 

1 1 "^a 

For the regularization error note that: 



< Ci llx^l a+u 



(33) 



X' 



R a y - x ] \\ r 

L- s g a (B*B)B*y-x^ 
L- s g a (B*B)B*BL s x ] 
L- s [g a (B*B)B*B - I}L s x 
L- s r a {B*B)Ux^\\ r 

L- s r a (B*B)(B*B)^^v 
L- s (B*B)^)r a (B*B)v 
(B*B)^ir a (B*B)v 



(because B*y = B*BL s x^) 



(by (J28 
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r — s 

< m a + s 



r — s 

m a + s 



u — r 

[B*B)^+^r a (B*B)v 



by (PD with v 



s — r 
a + s , 



r — s u—r 

< m a + s c^a 2 < a+s ) \\v\ 



r — s 



by fl20H with /2 



u — r 
2(a + s 



■ t O<p<l 



x ' 



2(g+s) i 2(a + s) 



r — s it — 7' u — r I, i 1 1 _ _ 



m a + s c 2 ( a+s ) 5 a + u 



s — U i 

[B*B)^^)L s x ] 



x 



t I I a + u 



r — s II .ii rLXJ u- 

< mt+» c A (c+ 1)(M+ 1) 5^ 



by (JT3J) with v 



(by (E 

s — it 
a + s 



r — s 

Thus there exists C2 = m«+s c^ (c + 1)(M + 1) such that 

II +11 II + II a+r u-r 

|p Q - 2:^^ < C 2 \\x ] \\ a u +u S~. (34) 
Finally, from (|33|) and (|34|) it follows that there exists C = C\ + C2 such that 

. . - 1 1 + 1 1 a+r u—r 

II" Mr — II Mm 

as we wanted to show. ■ 

Regarding the estimate for the total error (132]) in the previous theorem it is important to 
note the following: if r > then the order of convergence that we obtain is worse than the 
one obtained in Theorem 12.101 (see (123]) ). but now this order is obtained in the stronger ||-|| r 
norm. On the other hand if r < 0, then ||-|| r is weaker than ||-|| and therefore ( 132]) provides 
an estimate for the total error in a norm which is weaker than the norm in X . However, in 

/ u — r \ _____ 

this case it is important to note that the order O ( 5°^ J in (I32p is now better than the one 
obtained in (12"B"]) . 

It is worth noting here that the parameter choice rule (I3"T]) requires of the explicit knowl- 
edge of the degree of regularity u of x'. However, the following result shows that convergence 
can also be obtained in the norm ||-|| r when the parameter choice rule is chosen in the form 
a = 5 s , for e taking any value within a certain interval. 

Theorem 3.3. Let X, y, T, T\ L, {X t ) tm , s > 0, a > 0, B = TL~ S , g a , r a , R a = 
L~ s g a (B*B)B* , y E V{T^), y s E y, \\y - y 5 \\ < 5, u E [0, a + 2s},x^ = T^y E X u , x a = R a y 
y x s a = R a y 5 , all as in Theorem \2.1(K Let r E [—a, min{-u, s}] and suppose that the parameter 

Then 



choice rule a is chosen as a = cS e where e E ( 0, 

1 ' a+r 



2(a+s) 

I D C C I W, 



where a = min jl — fj^jy, 2(a+lj } • The °P^ ma ^ order of convergence is obtained when e 

is chosen to be e = > ^ n w hich case the order of convergence UJty) of Theorem \3.2\ is 
obtained. 



Regularization methods in multiple Hilbert scales 



12 



Proof. Following similar steps as in the proof on Theorem 13.21 it follows immediately that 

II X II a-\-r || , || u — r 

W-xJ < C x ol 2 ( a +*)5 and \\x a - x T < C 2 a^+^ . 



Since a = c 5 £ it then follows that 



K-x a \\ r KdS 1 '^ (35) 



and £ (u-r) 

x ] \\ r <C 2 5^) . (36) 

Form fl35l) and fl36|) it follows that 

Hxi-xt|| p =o(n 

where a = min jl — ||f^y, 2("+lj } • Also, fro m dSSJ) and ( 155]) we also have that the order of 
convergence is optimal when e is chosen such that 

e(a + r) e(u — r) 



2(a + s) 2(a + s) 



that is for e = 2i£t£i j n which case a = ' iL - L . 

a+u ' a+u 



It is important to note now that the results of Theorems 13.11 and 13.21 are obtained for 
particular choices of the parameters in Theorem 13.31 In fact if r = then we obtain the 
convergence result of Theorem 13.1] while for e = 2 ( a + s > the convergence result of Theorem 



a+u 

13.21 is obtained. 

In the next theorem we show that the optimal order of convergence in Theorem 13.11 
can also be achieved under the assumption of a source condition on x\ associated to the 
restriction of the operator T to the Hilbert scale X s , for some s > 0. 

Theorem 3.4. Let X, y, T, T\ L, [X t ) tm , s > 0, a > 0, /i > 1, B = TL~ S , g a , 
r a , R a = L~ s g a (B*B)B* , y E V(T*), y 5 E y, \\y - y 5 \\ < 5, = T^y, x a = R a y and 

/ u—s \ 

x s a = R a y 5 , all as in Theorem \2.1(A Suppose that x^ E 1Z ( (L~ 2s T*T\ x ) 2 ( a+s ) j for some 
u E (s, 2yU (a + s) — a] and that the regularization parameter a is chosen as 

2(a + s) 

/ o \ a+u 

a = c( J---J- (37) 



where c > 0. Then there exists a contant C (which depends on a and s but not on u) such 
that the following estimate for the total error holds 



i-x f \\<CS^. (3* 



Proof. Consider the operator 

T lxs :(X s ,\\-\\ s )^y- (39) 
Observe that W x E X s , y E y we have 

(x, L~ 2s T*y) s = (L s x, L~ s T*y) 
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= (x,T*y) 
= (Tx,y). 

It then follows that the adjoint of the operator T\ x defined in (1391) is given by T\ x = 

/ u — s \ 

L~ 2s T*. Hence, the source condition x t G 1Z ( [L~ 2s T*T\ x j 2(a+s) ] can also be written as 
1 G ft ((T tt T) ^> ) , that is x f = (T S T) ^> u for some v G 



On the other hand 



R a = L~ s g a (B* B)B* 
= L~ s B*g a (BB*) 
= L- s L- s T*g a (TL- s L~ s T*) 
= 1*g a {TI*) 

= g a {T*T)T\ (40) 

and therefore the family of operators R a constitutes a spectral regularization for the operator 
T\ Xs given in 

Observe now that 

s a 

I I rp° ™\ II <^ || rp® rJ\ \ | a + S | | rf \ \ | a + S 

W^a x || — H^a x ||_ a || x a x \\ s 

< m" 1 ||T(a£ - x^)\\^ \\x 5 a - x*\\f* , (41) 
where the first inequality follows from flTJ) with g = —a and r = and the second one from 

(USD. 

For the first factor in the RHS of ( 14"TT) we have the estimate 

\\T{x s a - x j )\\ < \\T(x s a - x a )\\ + \\T(x a - x f )|| 
< M + ca" +1/2 , 

with u = 2 (a+s) ' ^ = IMI anc ^ ^ as * n d23J), where the last inequality follows immediately from 
( )40|) and from Theorems 4.2 and 4.3 in [4] (note that < u < ji — |). Then, with a as in 
(1371) it follows that 

\\T(x s a - x ] ) \\< k6 + c ^ a+u U^r) (42) 



= {k + c\\x\ X )8 (43) 
<C<5, (44) 



where C = k + c(l + 7^ 2 W))( a + s )) ||xt|| \ Note here that C is independent of u. 

On the other hand, for the second factor in (1H]) . from Corollary 4.4 in [4j with [i = 2 (a+ s ) ■ 



we get the estimate 



l.r° — x*\\ < c5 2 ''+! = c5«+«, (45) 



where c > 0. 

Finally, with the estimates (142j) and ( 1451) in ( 14 ip we obtain that 

s a 

\\x 6 a - x^\\ < mT x \po\ a+s (c8%+z j a+s = C7)^, 
where C = m~ C a + s c a + a . This concludes the proof. 
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In the next theorem we will show that under the same conditions of Theorem 13.41 with 
the additional hypotheses that the operators L~ x and T*T commute, it is possible to obtain 
the same order of convergence as in (1381) . but now for a larger range of values of u. 

Theorem 3.5. Let X, y, T, T\ L, s > 0, a > 0, £t Q > I, B = TL- S , g a , r a , R a = 



L~ s g a {B*B)B* , y G D(Tt), y 5 G y, 



x' 



T^y, 



.If 



R a y y x d a = R a y s y a = a(6), 



all as in Theorem \2.1(A Suppose also that the operators L^ 1 and T*T commute and that 
x^ G TZ (^(B*B) 2 (°+ s ) \ for some u G [0,2/x (a + s)\. Then there exists a constant C (which 
depends on a and s but not on u) such that the following estimate for the total error holds: 



x ~ 



X 



Proof. To prove this result we will follow similar steps as those in the previous theorems, 
proceeding to estimate the error due to noise and the regularization error separately. Just 
like in Theorem 13. 1\ without loss of generality we will assume that y G TZ(T). For the error 
due to noise, with the same proof as in Theorem 13.11 from (1231) we have that 



x a x c 



(46) 

where C\ = km~^ with k as in ( |24l) and m as in ( Fl2l) . 

On the other hand, since L _1 commutes with T*T, it follows that L~ s commutes with 

. u 

B*B and therefore, with any function of B*B. Let v G X such that x T = (B* B) 2 ^+ S ">v. 
Then for the regularization error we have that 



x 



\R a y - x ] \\ 

\L- s g a {B*B)B*y-x^\\ 
\(L- s g a (B*B)B*BL s - I) 



x' 



g a (B*B)B*BL- s L s - I) x*\ 
(g a (B*B)B*B - I) (B*B)*& 

u 

r Q (B*B)(B*B)^+^v 

u 

(B* B)^^ r a (B* B)v 



v 



(since B*y = B*BL s x ] ) 
since L~ s commutes with T*T) 

since x ] G TZ ((B*B)^^^ 



<c^a 2 (°+ a ) \\v\ 



by flU]) with ft 



u 



2(a+s) 



Thus 

Finally from (gSJ) and Q17J) it follows that 



(47) 
(48) 



\x a - x^\\ < C x 5a 2(a+ s) + (7 2 0,2^+57 

= Ci5*+™ ||x T || a+u +C 2 5*+v \\x t \\ a+v 
= ( Ci II^H"^" + C 2 \\x*\\ a+u ) 6^ 
= C 5 a+u . 
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In the table below and in Figure [2] we illustrate the restrictions on the parameter u and 
the source condition for x' guaranteeing the order of convergence given in (1231) . These results 
where obtained in Theorems 12.101 13.41 and 13.51 respectively. 



Source condition 


Restriction on u 


x f e x u 


< u < a + 2s 


ell ({L- 28 T*T\ Xa )^+>)} 


s < u < 2fi (a + s) — a 


x^ eTZ *(«+•>) and L~ S T*T = T*TL- S 


< u < 2/i (a + s) 



\— I- 

s 



+ 



+ 



+ 



a + 2s 2/io(a + s) — a 2fio(a + s) 

Figure 2: Possible values of the parameter "it". 



In the following proposition, a relation between the source sets of Theorems 12.101 and 13.41 is 
shown. 

Proposition 3.6. Let X , y, T, L, (X t ) t( z^, s > 0, a > and B = TL~ S , all as in Theorem 
3.4 Then, for every u £ [s, a + 2s] there holds 



X u cn [(L- 2s T*T ]xs ) 2 ^ 
For u = a + 2s the inclusion in is in fact an equality. 



(49) 



Proof. Let T^ = L 2s T* the adjoint of the operator Tj as defined in fl3"9"l) . Then, for every 
x £ X„ we have that 



From this equality and (lT2"j) it follows that 

m llxll < ||(r tt 7|„ ) 1/2 x|| <M|b|| V x e X s . 

M ii— a — ||v I x s J \ \ g — 11 ii— a 

On the other hand, note that 

V((T«T lXs y^)=n((T% x f/2 ) 

= n(T s ) 
= n(L- 2s T*) 

— X a+ 2si 



(50) 



(51) 



where the last equality follows immediately from Lemma 12.61 
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Now, using ( J50l) . ( ISTl) and a duality argument it follows easily that 

XjF lkllo+2. < ||(^LJ~ 1/2 *II. < ^ ML* V * e <W (52) 

From (15 ip and (152]) . the use of Heinz inequality (Theorem 12. 4p for the operators L a+2s and 
(T^T]^) -1 / 2 allows us to conclude that for every v G [0, 1] there holds: 

V (L^ a+2s )) = V {(T^T\ Xs )- u/2 ) (53) 

and 

M -u < \\(T$T\ Xa Y v,2 x\\ < m~ v \\L v (a + 2s)x|| VifD (L^ a+2s )) . 

Finally we have that 
X u = V(L U ) 

= V((L a+2s Y) (with v = " 



P((T^JW) ^by (JMD with i/ 



^((T tt 7| 



lAr a 



I 2(a + 2s) 



a + 2s 
u 

a + 2s 



u 



C ft T»r 2 ("+=) since < < 

u ^ 7 V ~ a + s ~ a + 2s 

= K((r 2s n,,j^), 

which proves the first part of the lemma. 

For the second part, note that if u = a + 2s then 

= V((T% Xs )-^) (by ABU)) 

= n{{T% Xs y*) 
= n((PT lx )w) 



ll((L- ls T*T\ 



I 2(a + s) 



This completes the proof of the lemma. ■ 

It is worth noting that the inclusion in (l4"9l) reveals that the source condition x^ G 

1Z y(L~ 2s T*T\ Xs ) 2(a+ S ) j j n Theorem 13.41 is less restrictive than the source condition G X u 

of Theorem 12.101 for values of u G [s, a + 2s]. Therefore, the latter theorem can now be 
seen as a corollary of Theorem 13.41 Moreover, note that since fj, > 1, Theorem 13.41 is valid 
for u in a set which is larger than the one for which Theorem 12.101 holds. In light of this 
observation it is then reasonable to question the relevance of Theorem 12.101 The answer to 
this questioning is immediately answered by observing that the source condition x' G X u , 

/ ii— s \ 

although less restrictive than the condition x* G 1Z ( (L~ T*T\ x J 2 <- a+s '> ] is, in general, easier 
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to verify since it involves only the operator L while the second involves both L and T. On 
the other hand, if the operators L~ x and T*T commute, then there exist close connections 
between the source conditions in Theorems 12.101 13.41 and 13.51 We shall establish these 
connections in Corollary 13.111 An extension of the second part of Theorem I2.8[ namely 
identity f lT5|) for values of v > 1, will be previously needed. We shall obtain such extension 
in Theorem 13.101 A few previous results, which are presented in the next three lemmas, will 
be needed. 

Lemma 3.7. Let X, y , T, L, (XtjteM. and s > 0, all as in Proposition \3.6[ Suppose also 
that there exist positive constants m, M with < m < M < oo and a £ M + such that [W\l 
holds, i.e. 

m \\x\\_ a < \\Tx\\ < M \\x\\_ a \fxeX, (54) 

then: 
i) TZ(T*T) C x 2a . 
n) n(L- 2s T*T)cX 2{a+s) . 
If L _1 and T*T commute, then equality holds in both inclusions above. 

Proof. To prove i), observe that since Ai C X t V£ and .m" '* = X t , it follows immediately 

that X 2a " a = X a . Suppose now that x £ 1Z{T*T). Then from Lemma 12.61 x £ X a . 
Hence, there exists a sequence {x n } C X 2a such that ||x n — x|| a —> and therefore also 
||x n -x|| -> 0. Then ||TL 2a x n || < M\\L 2a x n \\_ a < M\\L a x n \\ < oo. Thus, the sequence 
{TL 2a x n } is bounded in y and therefore there exist y £ y and a subsequence of {x n } (also 
denoted by {x n }) such that TL 2a x n — > y. Finally, since the operator TL 2a is closed, we 
have that x £ V(L 2a ) = X 2a and, moreover, TL 2a x = y. Thus TZ(T*T) C X 2a , which proves 
i). 

Suppose now that L 1 and T*T commute and let x £ X 2a . Then L a x £ X a = 7?.((T*T) 1 / 2 )) 
(see Lemma |2.6[) . and therefore there exists x\ £ X such that L a x = (T*T) l l 2 x\. Then 
x = L _a (T*T) 1//2 a;i = (T*T) 1 ^ 2 L~ a xi, where the last equality holds by virtue of the com- 
mutativity of L' 1 and T*T. Now, since L~ a xi £ X a = TZ{{T*T) 1 / 2 ), it follows that there 
exists w £ X such that L~ a x 1 = (T*Ty/ 2 w. Finally then x = T*Tw £ K(T*T) and hence, 
equality holds in i). 

To prove ii), let x £ lZ(L~ 2s T*T). Then there exists x £ X such that L~ 2s T*Tx = x. 
But from i) it follows that T*Tx £ X 2a and therefore L~ 2s T*Tx £ X 2 ^ a+S y On the other 
hand if L~ l and T*T commute and x £ X 2 ^ a+S j C X 2s , then there exists L 2s x and L 2s x £ X 2a . 
Since in this case equality in i) holds, it then follows that L 2s x £ TZ(T*T). Hence there 
exists x £ X such that L 2s x = T*Tx , and therefore x = L- 2s T*Tx £ TZ(L- 2s T*T). This 
concludes the proof of the lemma. ■ 



Lemma 3.8. Let X , y , T , L, (X t )teR, s > 0, a > 0, m, M, all as in Lemma \3. 1\ and 
B = TL~ S as in Theorem \3.1\ If L _1 and T*T commute then: 

i) n(B*B) = X 2(a+s) . 

ii) m 2 ||x||_ 2 ( a+s ) < \\B*Bx\\ < M 2 ||x||_ 2 (a +s ) V x £ X. 

iii) M~ 2 ||a;||2(a+ s ) < \\{B*B)- 1 x\\ < mr 2 \x\ 2 (a+s) ViG X 2{a+s) . 
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Proof. Note that i) follows immediately from the previous lemma. To prove ii) observe that 
for every x G X we have 

B*Bx = L- 2s T*Tx 
= T*TL- 2s x 



T*TL 2a L- 2a L~ 2s x 



X. 



Thus 



1,8*5x11 = \\{T*T) 1/2 {T*T) 1/2 L 2a L- 2{a+s) 



= \\T{T*T) l ' 2 L 2a L- 2 ^x\\ 

< M\\(T*T) l/2 L 2a L' 2{a+s) x\\_ a (from (PJ)) 
= M\\(T*T) l/2 L a L- 2{a+s) x\\ 

= M\\TL a L- 2{a+s) x\\ 

< M 2 \\L a L- 2{a+s) x\\_ a (from (ED) 
= M 2 ||x||_ 2(a+S) . 

Similarly, by using the inequality m ||x||_ a < ll^ll, it follows that m 2 ||x||_ 2 ( 0+s ) < 
This completes the proof of ii). 

To prove Hi) let x G X 2 < ya+S )- Then 

B*B)- 1 x\\ = sup \{{B*B)- 1 x,x)\ 

||3||=1 

sup \{x, {B*B)~ 1 x)\ 

||S||=1 

= sup I (x, z) | 

||B*B*||<1 

< sup 1(^5^)1 (from ii)) 

zex 

m 2 IWI_ 2(a+s )<l 



sup \(x,m- 2 L 2(a+s) 



m~ 2 sup \(L 2 ^x,w) 

||to||<1 
171 2 ll X ll2(a+s) ' 



A similar reasoning allows us to prove that M 2 \\x\\ 2 ( a + s ) < \\(B*B) 1 x\\. This concludes 
the proof of the lemma. ■ 

In the following lemma it is proved that, under the hypothesis of commutativity of the 
operators A and L, Heinz inequality (Theorem 12 ,4p is also valid for v > 1. 



Regularization methods in multiple Hilbert scales 



19 



Lemma 3.9. Let A and L be two unbounded, self-adjoint, strictly positive operators on 
a Hilbert space X. Suppose also that T>(A) C D{V), A and L commute on T>(A) and 
\\Lx\\ < \\Ax\\ for every x G T>(A). Then for every k > it follows thatT>(A k ) C T>(L k ) and 
||L fc x|| < ||v4 fc x|| for every x G T>(A k ). 

Proof. If < k < 1, the result is true by virtue of Heinz inequality (Theorem 12. 4ft . Suppose 
then that k > 1. We will prove first that the result is true for all k G N, that is, we will first 
show, by induction, that V(A n ) C V(L n ) and ||L n x|| < \\A n x\\ Vx G V(A n ), Vn G N. For 
that let n = 2 and x G £>(A 2 ). Since x G V(A 2 ) C Z>(A) C D(L), there exists w = Lx. On 
the other hand, since x G V(A 2 ), Ax G 22(A) C T>(L) and therefore there exists z = LAx. 
Thus 

2! = LAx = ALx = Aw. 

Then w G 22(A) C T>(L) and therefore there exists r G A? such that r = = L 2 x. Hence 
x G 22(L 2 ). We have proved that V(A 2 ) C P(L 2 ). Also, for x G T>(A 2 ) we have that 
||L 2 x|| < \\ALx\\ = \\ALx\\ < \\A 2 x\\. 

Suppose now that V(A n ) C V[L n ) and ||L n x|| < \ A n x\ Vx G P(A n ). We will prove the 
inclusion for n+1. For that let x G P(A n+1 ). Since P(A n+1 ) C V(A n ) C I2(L n ), there exists 
w = L n x. On the other hand, Ax G T>(A n ) and by the inductive hypothesis T>(A n ) C T>(L n ). 
Then there exists 2 = L n Ax. Thus 

2 = LMx = v4L n x = Aw. 

Then w G 22(L) and therefore there exists r = = LL n x = L n+1 x. Hence x G T^L™ 4-1 ). 
Also, if x G P(A" +1 ) then ||L n+1 x|| = ||L n Lx|| < ||A n Lx|| = ||LA n x|| < ||A n+1 x||. 
We have then proved that for every n£N 

V(A n )dV(L n ) and ||L n x|| < ||A n x|| Vx G V(A n ). (55) 

Suppose now that k G M + \ N and define n = \k] (where "[■]" denotes the "ceiling" 
function). Since n G N, from (1551) we have that £>( J 4 ?l ) C T>(L n ) and ||2v n x|| < ||A n x||. Now, 
by using Theorem 12.41 with L and A replaced by L n and A n and v = j|t, it follows that 
D(yT) C V(L V ) and ||L^x|| < ||A"x|| Vx G V(A U ), that is 

D(/)cD(L k ) and ||L fe x|| < ||A fc x|| Vx G P(A fc ). 

■ 

Having proved the three previous lemmas, we are now ready to prove an extension of 
the identity ([15"]) of Theorem 12.81 which will allow us to show the relationships between the 
source conditions of Theorems 12.101 and 13.51 that is, conditions of the form x^ G X u and 

x^ G 1Z i^[B*B) 2 ( a + s ) j , for the case in which L^ 1 y T*T commute. 

Theorem 3.10. Let T : X — > y be a linear continuous operator between the Hilbert spaces 
X and y , L a linear, densely defined, unbounded and strictly positive operator on X , and 
(X t )tm the Hilbert scale induced by L over X . Let also s be a positive constant, B = TL~ S 
and suppose that there exist positive constants a, m and M such that (TT^j) holds. Assume 
also that L^ 1 and T*T commute. Then for every v > we have that 



n({B*B)$) =x v{a+s) . 



(56) 
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Proof. First note that from Lemma KB i) it follows that V^B)- 1 ) = X 2{a+s) = V(L 2{ - a+s) ). 
On the other hand since the operators L~ l and T*T commute, then T*T and L~ r also 
commute for every r > (see pjj, page 140). Then, the operators B*B = L~ S T*TL~ S and 
j^-2(a+s) com mute and therefore their respective inverses also commute. From Lemma 13.81 
Hi) and Lemma [3.91 it then follows that 



V {({B*B)- 1 ) V ) = V ((L 2 ^)") V v > 0, 



that is 

1Z((B*B) U ) = X 2u ( a +s)- 



The following corollary shows the relation between the source conditions of Theorems 
I2TT01IO and 1331 

Corollary 3.11. Let X, y, T, L, (Xt)teR> s > a an d B as in Theorem \3.1(A Then 

i) X U = TZ ([B*B)^)^j V« > 0. 

ii) TZ ([L- 2s T*T)^)^j C K f(r 2 T^J^) V« e[s,a + 2s}. 

Proof. Part % ) follows immediately from Theorem 13.101 with v = . To prove ii ) note that 
if u € [s, a + 2s] then 

K ([L- 2s T*T)^)^j = K ({B*B)^)^j (since L~ s y T*T commute) 

= X u (by i)) 



C TZ ((L- 2s T*T lXg )^)^J . (by Proposition M. 



Hence 

n ^(r^rr) 5 ^)) c n ({l- 2s t*t 1xs )^)^ , 

as we wanted to prove. ■ 

Remark 3.12. Under the hypothesis that the operators L _1 and T*T commute, Corollary 
\3.11\ implies that for u £ [s, a + 2s] the source condition E 1Z (^(B* B) 2l - a+s ^ of Theorem 

\3.5\ is more restrictive than the source condition e 1Z (^(L~ 2s T*T s ) 2 (°+ s ) ^ of Theorem 3.^. 

However, it is important to point out here that Theorem \3.5\ is valid for a set of values of u 
which is larger than the one for which Theorem \3.4\ is valid. In particular, Theorem \3.5\ is 
valid for values of u G (2/z (a + s) — a, 2/i (a + s)] (for which Theorem \3.J\ is not valid), thus 
allowing us to obtain better orders of convergence. 
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4 Main Results 

4.1 Multiple Hilbert scales 

In this section we will first introduce the concept of a multiple (or vectorial) Hilbert scale. 
Then we shall define a regularization method in these multiple Hilbert scales and prove 
several convergence theorems, some of which generalize results obtained in the previous 
section. 

Let T be a linear continuous operator between the Hilbert spaces X and y. Consider 
also iV linear, densely defined, unbounded, strictly positive, self-adjoint operators , with 
open dense domains. 

Li : V(Li) C X — >X, i = l,2,...,N. (57) 

Thus, each Lj is a closed operator on X satisfying: DiLj) = L>(L*) is dense in X, (LiX,y) = 
(x,Liy) for every x,y G T>[Li) and there exists a positive constant ji such that (LiX,x) > 
7i ||x|| 2 for every x G V(Li). 

In what follows we shall obtain regularized solutions of the ill-posed problem Tx = y, by 
means of the simultaneous use of the iV Hilbert scales induced on X by the operators L i} 
1 < i < N. The motivation for this development comes mainly from the idea of combining 
the advantages of the use of general penalizing terms in Tikhonov-Phillips type methods (see 
[9]) with the adaptive virtues that regularization in Hilbert scales possess in regard to the 
order of convergence of the total error as a function of the degree of regularity of the exact 
solution. In order to do that we will previously need to extend some of the concepts and 
definitions that were introduced in Section [2j 

For each index i, 1 < i < N, consider the set Aii of all the elements x G X for which all 
natural powers of Li are defined, i.e. Aii = f > |^ 1 'D(Lf). As seen in Section [2} A4i is dense 
in X, the powers Lf are well defined on Aii for every s G M and Aii = f] s£R V(Lf). Now, 
for each i = 1, 2, . . . , N, and for each s G M we define the mapping (•, : Aii x Ai { — > C 
as (x,y)L itS = (L^x,L^y), x,y G M.{. Again, as seen in Section [21 defines an inner 

product in Aii, which induces the norm \\x\\ L . s = \\Lfx\\, and Li induces on X a Hilbert scale, 
that we shall denote with (X t Li )tm- Here X t Li is the completion of Aii in the r norm. 

N 

Let us now consider the Hilbert space X consisting of iV copies of X, i.e. X N = (g)X 

8=1 

with the usual inner product in a product space. With the operators L 1; L 2 , . . . , L N given in 
(157]) we define the operator L : X — > X as 

N 

V(L) = 0P(Li), L^diag^La,...,^), (58) 

i=l 

so that for x = (x 1 ,x 2 , . . . ,x N ) T G T>(L) one has Lx = (L 1 x 1 , L 2 x 2 , ■ ■ ■ , L N x N ) T . Given 
the operator L defined as in (!58j) and s = (s 1 , s 2 , . . . , s N ) T G M N , the operator L s is 
defined as L g = diag(Lf x u L s 2 2 x 2 , . . . , L s N N x N ), i.e. V(L g ) = ^ =l V{L^) and for x = 
(x 1 ,x 2 , . . . ,x N ) T G V(L S ) 

L s x = (LI 1 x 11 L 2 2 x 2 , . . . , LJ* Xff 

r ■ (59) 
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Now, for every s = (s 1 ,s 2 , . . . , s N ) T G ~R N and x,y G M. = (£) i=1 Mi, we define (x, y)^s = 

TV TV 

^.{ x iiVi) L Si — '^.{LfxijLfyi). It can be immediately seen that {■■,■) ^ defines an inner 

i=l _ i=l 

product in Ai, which in turn induces the norm \\x\\ 2 cS = Y^i=i \\^i ix i\\ 2 - 

Definition 4.1. (Multiple or vectorial Hilbert scale) Let L be as in ( ESP , s = (s 1: s 2 , ■ ■ ■ , s N ) T G 
R N and M = <S>Zi M *- The Hilbert space Xi is defined as the completion of M. with respect 
to the norm The family of spaces (Xg)? eK N is called the vectorial Hilbert scale induced 

by L over X N . The operator L is called a "generator" of the Hilbert scale (X^) gm N. 

Remark 4.2. Since L is diagonal, it can be easily seen that HjXg = X^ 3 where IT,- is the j-th 
canonical projection of X N onto X. Moreover, for any t G M. one has that X t N = Xf tt t) , 

where X t N denotes the usual (single) Hilbert scale induced by L on X N . Note here that 
X t N is defined for any positive self-adjoint operator L (not necessarily diagonal) on X N . 
Also, although here we are only interested in the case in which Xi = X Vz ; the definition 
of a multiple Hilbert scale can be extended to the case of an arbitrary product Hilbert space 
X = <S)iL\ %i i n an obvious way. 



4.2 Regularization in multiple Hilbert scales with a single obser- 
vation 

Next we proceed to define an operator B which will allow us to define a regularization for T^ in 

TV TV 

a multiple Hilbert scale. Consider the Hilbert spaces X N = (S?) X and y N = (S?) 3^, each one 



of them with the usual inherited inner product. Given s*G the operator B : X N — > y N 
is defined as B = TL~~ S , where T : X N — > y N is defined by T = diag(T, T, . . . , T). Thus, 
given x G X 

Bx = TL~ g x = {TL- Si x x , TL~ S2 x 2 , . . . , TL~ SN x N ) T . (60) 

From the properties of the operators L i; it follows immediately that the adjoint of B is given 
by B* = L~ g f*, where f* = diag(T*, T*, . . . , T*). Thus, for every y G y N we have that 

B*y = L- 3 f*y = {L^T* Vl , L^T*y 2 , L~^T*y N ) T , (61) 
and therefore for every x G X there holds 
B*Bx = L- g f*TL- g x 

— ( T ~Sirp*rp J -S\ T —S 2 rp*rp T —S 2 T - S N rp*rp j - s N \ T 

— 1 1 1j 1 X 1 ,Ij 2 1 1 1j 2 X 2 ,...,Li n 1 1 Li N X N ) 

= (B:B iXi , B* 2 B 2 x 2 , . . . , B* N B N x N ) T , (62) 

where Bi = TL~ Sl y B* = L~ Si T* is the adjoint of the operator Bi (compare with the 
definition of B given in Theorem 12.8ft . Note that the operators B*B and B*Bi, for each 
index i, 1 < % < N, are linear self-adjoint operators on the Hilbert spaces X N and X, 
respectively. As such, for each one of them there exists a unique spectral family which 
allows them to be represented in terms of the integral of the identity with respect to the 
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"operator valued measure" induced by that spectral family. We shall denote with {Ef * b }agr 
and {£^ Bi }agr the spectral families of the operators B*B y B*Bi, respectively (note that 
these families are partitions of the identity on the spaces X N and X respectively). 

Let g : K — > K be a piecewise continuous function and consider the operators g(B*B) : 
X N — > X N and g(B*Bi) : X — > X, 1 < % < N. From ([62]) it can be easily proved that 

[g{B*B)S) =g{BlB l )x % , (63) 

where x = (x 1} x 2 , ■ ■ ■ , x N ) T . 

The next theorem states a convergence result which generalizes Theorem 13.11 to the case 
of multiple Hilbert scales. 

Theorem 4.3. Let T G C{X,y) with X and y Hilbert spaces, L t : V(Li) C X — y X, 
1 < i < N, linear densely defined, self-adjoint and strictly positive operators on X , each one 
of them with open domain, Li > ji for a constant ji > 0, and let L : X — > X be as 
in (ESj). Suppose also that for each index i, 1 < i < N, there exist constants rrii, Mi, with 
< rrii < Mi < oo, and ai > 0, such that for every x G X the following condition holds: 

m i ll x IL. - a - — ^ Mi \\ X \\ L . _„. • (64) 

Lets = (s l5 s 2 , . . . ,s N ) T elf, f = diag(T,T, . . . ,T), B = fL~ g , ff = ( Vl , ^ . . . , n N ) T G R% 

N 

such that = 1- Also let g a : [0, ||S|| 2 ] — y 1R, a > 0, be a family piecewise continuous 

i=l 

real-valued functions verifying the following conditions: 



CI: For every A G (0, ||-B|| 2 ] there holds lim a _ i . + g a (X) = j 



x ■ 



C2: There exists a constant c > such that V A G (0, 
\g a (X)\ < cor 1 . 



B 



and V a > there holds 



C3: There exists fj, > 1 such that if /j, G [0,/i () ] then A^|r a (A)| < c^ V A G (0, ||5|| 2 ], 
where c^ is a positive constant and r a (X) = 1 — \g a (X). 

For y G T>(T^) and y 5 G y with ||?/ — < 5, we define the regularized solution of the 
problem Tx = y with data y s , as 

x 5 a = ff. (L- s g a {B*B)B*y 5 ) , (65) 

y S = {VilJ 6 -! ■ ■ ■ >y S ) T £ y N ■ Suppose that for each index i, 1 < i < N there exists Ui G 
[0,aj + 2si] such that x^ = T^y G X^ , i.e. ay G Xi , where x^ = (x\ x', . . . , x^) T , u = 
u 2 , . . . , u N ) T and (X t Li ) teR , {Xi) Ul - w N are the Hilbert scale induced by Li over X and 
the multiple Hilbert scale induced by L over X N = <S>i=i % > respectively. Suppose that the 
regularization parameter a is chosen as 

a = a(5) = c5 £ with e G (0, min ( 2 ^ + ^ \ ) , (66) 



where c > and, for each index i, with 1 < i < N , ai is the constant in (64\ ). Then: 
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i) \imx 5 n( <;\ = x^ and, moreover, 

ii) the total error satisfies the following order of convergence: \\x s a — x^\\ = 0(5 a ) where 



a = min min < 1 — 



2(aj + 2(aj + 

Hi) The order of convergence of the total error in ii) is optimal when in IRJh)) the value of 
e is chosen as 



( a i 
max — + mm 

yi<i<N 2(aj + Si) i<»<iv 2(a» + s 



Ui 



in which case \\x s a — xMl = O(5 ao ), where a = 



mm 



i<i<iv 2(ai + Si) 



"77" 



mm 



+ max 



i<i<iv 2(aj + Si) i<i<N 2(ai + Si) 

Proof. Applying Theorem 13.11 to each operator Lj, 1 < i < N, since e < ^h±£A w ith the 
choice of a as in (166]) it follows that 



1^-^11 = 0(^0 



(67) 



where 



4 a = L; s 'g a (B:Bi)B*y 5 and a { = min <| 1 



me 



Then, 



\xt - x f | 



77. (L- s g a {B*B)B*y & ) 

N 

Y,ri l Lr i g a {B1B l )B*y 5 - 

i=i 

N 



7nf^ rf\ 



i=l 
N 



8=1 

N 



\ X i,a X ^\ 



i=l 
N 

i=i 

_ min oa 

< C5^ N 
= C5 a , 



2(di + sA 2(ai + Si) 



(by dMD) 

(by (JSHD) 



f N \ 

since 77j = 1 J 
K *=1 / 



(by (EZD) 



(68) 



where C is a positive constant (for instance for 5 G [0, 1], C can be taken as C = max q). 
That proves i) and mJ. To prove Hi) note that from Theorem 13. 1[ more precisely from (|30|) . 
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there exist positive constants q, dj, 1 < i < N, such that 

N 

i=l 
N 



- Z^Vi [Ci5a 2 ^+^ + dia^+^ J fbv (|30l)^ 

i=i 

— max t r mm 777 7 7 

< C\ 5a 1 < i < N iai + Si) -)- C 2 Q/l<i<JV 2(a i +S * ) 



= d^ i<»<iv5KW +C25 k,< W 2kW ] (by (JBSD) (69) 

where Cj and Ci are generic positive constants. 

Finally, from (169]) it follows that the order of convergence of the total error is op- 
timal when e satisfies 1 — max 9 , ea ! > = min 9 , £U J_ . , that is when e is chosen as £ = 

mux — — — r + min — — — ) in which case, also from (1691) . it follows that \\x s n — 



i<i<N 2(a, + Si) i<i<N 2(Oj + s» 



mm 



/r»/tvrn\ ! 1 l<i<iV 2(aj + Si) , 

O(o "), where a is given by a = ^ ^ • I 

min — r + max — - 

i<i<w 2(oj + Si) i<*<iv 2(ai + Si) 

Remark 4.4. From / fffgj) it follows that the regularized solution x s a = fj . ( L~ s g a (B*B)B*y s 



defined in ( fffSl) can also be written in the form x 5 Q = Vi x i, a where x\ a = L i Si g a (B*Bi)B*y 



N 

*„.<5 



i=l 



is a single regularized solution of the problem Tx = y in the Hilbert scale of order s^ induced 
by the operator Li on X , so that xf a G X^. Therefore x 5 a is a convex combination of such 
solutions. In contrast with what happens in the case N — 1, where it is known that the 
regularized solution is in V(L S ), here, the degree of regularity of x 5 a is not explicitly known 
since the Hilbert scales X£* are not necessarily related. 



4.3 Regularization in multiple Hilbert scales with multiple obser- 
vations 

In Theorem 14.31 we noted that, given a single noisy observation y s , we generated the "ob- 
servation vector" y s G y N by using N copies of y s . In practice it may happen that N 
different observations of y, say yf , y\ , . . . , y s N , such that \\yf — y\\ < 5 V i = 1, 2, N, be 
available. In such a case we can use them to construct the observation vector in the form 
V 5 = (Vi, V S 2 , ■ ■ ■ , y 5 N ) T e y N - Defining now 

x 5 a = f). (L- 3 g a {B*B)B*f) , 

(with fj, s, g a , B , a = c5 £ as in Theorem I4.3[) it can be easily seen that the same re- 
sults of Theorem 14.31 remain true. In particular, we have that lim llx^ — x^\\ = and 

I CIS U '£ ! 

Wxi — x^\\ = 0(5 a ) with a = min min < 1 ; — -, — — >. However, in this case 

11 a 11 K J i<*<* I 2(ai + Si y 2(ai + Si)S 
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of regularization in multiple Hilbert scales with multiple observations, it is also possible to 
utilize different types of regularization methods (i.e. different g Q 's) for each one of the ob- 
servations yf , 1 < i < N, in each one of the N Hilbert scales, maintaining the convergence 
to the exact solution and even improving the order of convergence. This may be of partic- 
ular interest when certain u a-priori" knowledge about the i th observation suggests the use 
of certain type of regularization method. In order to proceed with the formalization and 
presentation of this result, we will previously need to extend the definition of a "function 



of a self-adjoint operator" f(A), to the case in which / : M 
tion and A is a self-adjoint operator in a product space X 



is a vector-valued func- 



N 



Xi, where Xi is a Hilbert 



, / = (fu /a, • • • , fn) , f be piecewise 

( TP A TpA rp A \ T 



X 



X. 



space for every i = 1, 2, . . . , N. Let / 
continuous, {E^ }asir the spectral family of A, E 

E xi : X - r < n y^wuv, ^ X>i 

We define the operator f(A) as the spectral vector-valued integral 

/ : \ 



Xi (note that E Xi is the i th component of the projection operator E^ on X). 



f{A) x 



/(A) dEfx 



\ 



(70) 



where "©" denotes the Hadamard product, with domain given by 

V(f(A)) = <SeX: y £J J?(\)d \\Eix\\ 2 < oo | . 

/oo 
fi(X) dE Xi x, the family {E^^xeR 
-oo 

is not a spectral family (in fact it is not a partition of unity but rather a parametric family 



of canonical projections of a spectral family on the product space 

x = ®i=i X i)- However, 

under the hypothesis of piecewise continuity of /, it can be easily seen that its existence is 
guaranteed by the classical theory functional calculus. In fact, given any i, 1 < % < N, by 
defining g : 1R — > JR N as (?(A) = (/,(A), /i(A), . . . , f i (X)) T , since / is piecewise continuous, so 
is g and therefore the operator g(A) is well defined and it is clear that for every x G T>(g(A)) 

/oo 
/i(A) dE X i x. 
-oo 

With this extension of the concept of a function of an operator to the case of vector- valued 
functions of self-adjoint operators on product spaces, we are now ready to present the fol- 
lowing theorem which extends the result of Theorem 14.31 to the case of multiple observations 
with vector-valued regularization functions in multiple Hilbert scales. 

Theorem 4.5. Let X, y, X N , y N , T, f, L h (X t L % eM , s, B, = TL~ S \ 1 < % < N, L, 
{Xj) aem N, B = TL~ S and ff, all as in Theorem \4-3\ For each index i, 1 < % < N, let 
g l a . : [0, ||5j|| 2 ] — > R, on > be a family of piecewise continuous functions and r l a .(X) = 
1 — Ag^.(A). Suppose also that each one of the families {g l a .} verifies the conditions CI, C2 
y C3 of Theorem \4-3\ that is: 



CI : V AG (0,||B< 



1 



there holds lim g l a .(X) = —. 

a^0+ % A 
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C2 : 3 di > such that V A G (0, ||-Bj|| 2 ] and V ctj > i/iere /io/ds |fl , L i (^)| — ^i a t 
C3 : 3 fj* > 1 suc/i tfmi if ^ £ [0,//*] toen A M |4.(A)| < cj,a? V A G (0, ||Af ], 

where the d 's are positive constants. Let us denote now with V the 

"vector-valued regularization parameter" and with g$ : IR — > E w the function given by 
<?a(A) = (^(A), #a 2 (A), . . . , (A)) and /ei g^(B*B) be the linear continuous self-adjoint 
operator on X N defined via §7D\) . Let y G V(T^), y s x , yf, . . . ,y 5 N G 3^ fre such that ||wf — < 
5 V z = 1, 2, iV and y 5 = (yf , y 2 , . . . , y^) T G 3^- W^e define the regularized solution x s of 
problem (CP given the observations yf,y 2 , , ... , yfr, wffii/i regularization methods y^, (■) , fl'L(-) , 
. . . , g% N (-), in the Hilbert scales X^ 1 , X^ 2 , . . . , X^ N induced by the operators L 11 L 2 , . . . , L N 
over X , with the weights r] 2 , . . . , rj N , as 

4 = 4 (gs, V, L, y 5 , s) = ff. {L- g UB*B)B*y s ) . (71) 

Suppose also that V i, 1 < i < N, there exists Ui G [0, aj + 2sj] such that x^ = T^y G X^ , 
i.e. $ G Xi , where x* = (x^, x\ . . . , x^) T and u = u 2 , . . . , u N ) T . If the vector-valued 
regularization parameter a is chosen in the form 

a(S) = ( Cl S £ \c 2 6 £ \...,c N S £N ) T (72) 

where a > and < e< < 2(a,+Sl) , 1 < i < N, then: 



114 


— x^\\ 




114 


— x^\\ 





CLiSa UjSi 



2(a, + Si) 2(oi + Si 

TTie order of convergence of the total error is optimal when the vector regulariza- 
tion parameter in (TOfy is chosen such that Si = 2 ^*+*^ , in which case one obtains 
.8 _ „tll - /nrx<r*\ ^* - m ™ Ui 



X ^ X 



0(5 a *), where a* = min 



i<i<N a; + Ui 



iv) The optimal order 0(S cr ) in iiij which is obtained with this vector-valued (regulariza- 
tion method) g$, is at least as good as the optimal order O(8 ao ) which is obtained with 
a single observation and a scalar g a (X) (see Theorem \4-3\ Hi)). 

Proof. If {E B * B }\ £ j& and {E^ iBl }\ &tL denote the spectral families of the operators B*B and 
B*Bi, respectively, from the definition of B and ( |60|) . it can be immediately seen that 
[B*Bx\i = B*BiXi and [E B * B x\i = E^ Bi Xi and therefore, from ([7D|1 . it follows that Vi = 
(xj, x 2 , • • • , x jy) G X 

UB*B)x = (g^Bjx!, g 2 a2 (B*B 2 )x 2 , . . . , g^ N (B* N B N )x N f . 

As in Theorem 14.31 let xf a . G X^ 1 be defined by 

xt^^L^gUiBtB^Btyf. (73) 
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For each index i, 1 < i < N, let Oi = min <; 1 
Then 



CLjEi 



UjEi 



2(di + Si) 2(a, + Si 



and a = min <7j. 

Ki<N 







Wxi - 

II a 


- X'\\ 



* -*5 



fj.[L- s UB*B)B*y 

N 



X' 



^ViL^g^B^BlyS-xi 

i=l 
N 



i=l 

JV 



(by (E3D) 



i=l 
N 

i=l 
N 

<Y,ViCi5 a > 

i=l 

< C5 a . 



N 

since rji 

i=l 



X ' 



(74) 



(for a as in f[T2"j) . by Theorem 13.11 m)) 



This proves and ii). 

Now, if the vector-valued regularization parameter a in (!72|) is chosen so that £j = 
2{ai+Si) _ i 2,...,iV, then by virtue of Theorem 13.11 Hi) it follows that there exist 

positive constants c 1; c 2 , . . . , c N , such that ||^f iCei — < Q <5 Vz = 1, 2, . . . , N. Then it 
follows from (1T4"|) that 

TV 



A til X — ^ ' 

\%a — % T | < y j rjjCj o a i+ v 



i=i 



It,; 



-. It is also clear that for Ui and ctj fixed, this order of convergence is 



where a* = min 

i<i<N <2j + Ui 

optimal and, as we can see, independent of the choice of s. This proves Hi). 

Finally, to prove iv) we must verify that a < a*, where a is the optimal order in 
Theorem 14.31 Hi), that is 



mm 



o- 



i<*<jv 2(ai + Si 



Ui 



mm 



+ max 



ft; 



i<i<jv 2(aj + Si) i<i<iv 2(aj + Si) 
For that, observe that since at, Ui and Sj are all positive, there holds 

'2(fti + s. 



max 

Ki<N 



Ui 



max 
i<!<jv \ 2(ai + s it 



> max — 



i<i<jv \ Ui 
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or equivalently 



from where it follows that 



max 

i<*<iv \ 2(ai + Si) J I di 

> max — , 

Ui \ l<i<N \ Ui 

mm 



i<i<jv V 2(aj + Sa 



1 + 



max 

i<i<jv y 2(a,i + Si 



mm 



i<i<N y 2(di + Si 



< 



1 + max 

l<i<iV \ Ui 



max I 1 H 

Ki<N \ Ui 



and therefore 



U-, 



mm 



0",, 



i<i<jv 2(di + Si 



Ui + di 

max 

l<i<N \ Ui 



Ui di 

mm — + max — - 

l<i<AT 2{di + Si) l<i<N 2(di + Si) 



< min 



Ui 



i<z<n y aj + Ui 



that is a < a*, as we wanted to prove. 

In the presence of a fixed noise level S in the iV observations yf,yf, 



in light of 



Theorem 13.11 in), one should not expect that the order of convergence 0(5 a *) = 0(5 mm ) 
in Theorem 14.51 can be improved. However, if the noise levels can be controlled, then by 
appropriately doing so on those components on which it is known that the degree of regularity 
of the exact solution on the corresponding Hilbert scale (measured in terms of Ui) is 
relatively small or the corresponding parameter of comparison of relative regularity between 
the operators T and L~ , measured in terms of di (see ( )64l) ), is relatively large, then the 
order of convergence 0(5 a *) can in fact be improved. More precisely we have the following 
result. 



Theorem 4.6. Let X, y, X N , y N , T, T, Li, u h d h 1 < % < N, u, s, L, B = TL~ 



TL Sl , a, g$, y G P(T^) , = T^y, x^ G Xi and fj, all as in Theorem ^. 5 Let yf 1 , y. 



y be such that \\yf' - y\\ < Si V i = 1, 2, N, S = (S u S 2 , . . . , 5 N ) T and y s = (yf^y 6 , 2 , 
y N and define now the regularized solution x s s of the problem Tx = y as 



x 



x ,, 



If 5 i = ^ m th 



g 5 , 77, L, y 5 ,s) = fj. [L~ g g s (B*B)B*y 



Pi > 



Bi = 



(75) 



max 

i<fe<jv ak + Uk 



(76) 



ai+Ui 
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for every 1 < i < N , and the vector-valued regularization parameter a(S) is chosen in the 
form 



2(a 1 +s 1 ) 2(g 2 + S2) 



2(a N +s N ) 



a(S) = US, , c 2 S 2 a2+ " 2 , . . . , c N 5 N aN+UN 
where Ci, c 2 , ■ ■ ■ ,c N are arbitrary positive constants, then 

0{S a ), 



■2' Q X 



(77) 



(78 



where a = max 



1<*<JV Oj + 



2 I Wl 



Proo/. Let on = cA " l+Ul and x^ a . = LT Si g^B* Bi)B*yf\ By virtue of Theorem O raj it 
follows that there exist constants k 1} k % , . . . ,k N such that 



l^-^H < Mr + "\ 1 < i < N. 



(79) 



On the other hand, by following the same steps as in Theorem 14.51 for x| defined as in ([75 
one has that 



N 



x S a - x 1 " < '^rji \\x 



i=l 

N „. 

i=l 

TV 



i=l 



U; 



max 



< C S 1 - 1 - 1 * U i + a i 

= CS & . 



(by m: 



(since & = S Pi ) 



(by ((76 



Note that in order to obtain the order of convergence in fjTHj) it is necessary that the noise 

Uk 

max 



level in the r component be Si = S Pi with pi > 



(> IV i). Hence, the precision 



in the observations must be improved precisely in those components for which the regularity 
of x*> as an element of the corresponding Hilbert scale, namely u^, is relatively small or the 
parameter ai is large. 



5 Conclusions 

In this article several convergence results in Hilbert scales under different source conditions 
are proved and orders of convergence and optimal orders of convergence were derived. Also, 
relations between those source conditions were proved. The concept of a multiple Hilbert 
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scale on a product space was introduced, regularization methods on these scales were defined, 
first for the case of a single observation and then for the case of multiple observations. In the 
latter case, it was shown how vector-valued regularization functions in these multiple Hilbert 
scales can be used. In all cases convergence was proved and orders and optimal orders of 
convergence were shown. 
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